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(54) METHOD AND EQUIPMENT FOR INSPECTING MOUNTED DEVICE 

(57)Abstract: 

PROBLEM TO BE SOLVED: To reduce the time 
and labor required for teaching the set position of 
inspection area while enhancing the inspection wr _ 
accuracy. 

SOLUTION: In the equipment for inspecting a 

mounted device, inspection areas of land windows , W 4 
Wl, body window W2 and device body window W3 
are set, at previously taught positions on the image 
of a device to be inspected, along with a recognition 
window W4 being used for positioning these 
inspection areas before performing an inspection. 
Prior to the inspection, a control processing section 
extracts the land part of device from the image data 
in recognition window W4 and alters the land 
windows Wl, along with the set position, based on 
the extraction results. Subsequently, the set position 
of body window W2 is altered with reference to the 

positions of land windows Wl. Furthermore, the wa 
control processing section extracts the image of 

device from the image data in recognition view area W4 and alters the set position of device 
body window W3 based on the extraction results. 
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* NOTICES * 



JPO and NCIPI are not responsible for any 
damages caused by the use of this translation. 

1. This document has been translated by computer. So the translation may not reflect the 
original precisely. 

2. **** shows the word which can not be translated. 
3. In the drawings, any words are not translated. 



CLAIMS 



[Claim(s)] 

[Claim 1] In the approach of setting up the inspecting region of components on the image 
which picturized the mounting components on a substrate and was obtained, and inspecting 
the mounting quality of components using the image data in this inspecting region The image 
to be examined which exists near the setting-out location of the inspecting region where it 
was beforehand taught on said image is extracted. The inspecting region setting-out 
approach characterized by judging the mounting quality of components using the image data 
in the inspecting region after modification after changing the setting-out location of said 
inspecting region based on this extract result. 

[Claim 2] A storage means to be mounting components test equipment which inputs the 
image which picturized the mounting components on a substrate arid was obtained, sets up a 
predetermined inspecting region, and inspects the mounting quality of components using the 
image data in this inspecting region, and to memorize the setting-out location of said 
inspecting region, The image data near the setting-out location of the inspecting region 
memorized by said storage means on the inputted image is processed. An image extract 
means to extract an image to be examined, and a setting-out repositioning means to change 
the setting-out location of said inspecting region based on the extract result by said image 
extract means, Mounting components test equipment which is equipped with an inspecting 
region setting-out means to set said inspecting region as the setting-out location changed by 
said setting-out repositioning means, and a judgment means to judge the mounting quality of 
components using the image data in the inspecting region set up by said inspecting region 
setting-out means, and changes. 

[Claim 3] Said image extract means is mounting components test equipment indicated by 
claim 2 which is a means to process the image data in a predetermined field including the 
setting-out location of said inspecting region, and to extract the image of the land of 
components to be examined. 
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DETAILED DESCRIPTION 



[Detailed Description of the Invention] 
[0001] 

[Industrial Application] It is related with the method of setting up an inspecting region 
inspecting existence, a position, etc. of electronic parts before soldering, and for after 
soldering inspecting the quality of soldering etc., respectively, and the mounting components 
test equipment which inspects the mounting quality of mounting components using that 
approach about the electronic parts with which this invention was mounted in the printed 
circuit board (only henceforth a "substrate"). 
[0002] 

[Description of the Prior Art] Although mounting quality is conventionally inspected about 
the mounting components on an inspected substrate (the thing before soldering and the thing 
after soldering are named generically, and it is called "mounting"), inspection by viewing is 
conducted. However, in this kind of visual inspection, generating of an inspection mistake is 
not avoided, but by those who also inspect an inspection result, it is various and there is a 
limitation also in an inspection throughput. 

[0003] Then, the mounting components test equipment which inspects the mounting quality 
of each part article automatically using an image processing technique was put in practical 
use in recent years about the substrate with which many components were mounted. When 
using this mounting components test equipment, it is necessary about what kind of 
component is mounted in which location on an inspected substrate how to teach mounting 
components test equipment for every classification of a substrate in advance of inspection. 
Generally this instruction activity is called "teaching." 

[0004] To the aforementioned instruction data, besides the location of the components 
mounted on an inspected substrate, or a class The body of components, a lead, In order to 
extract the setting-out location of the inspecting region set up for every subjects of 
examination, such as a land, and an image pattern to be examined in each inspecting region 
The reference value of characteristic quantity (it is named a "feature parameter" generically 
below), such as area of an image pattern and a configuration, extracted in the inspecting 
region with the binary-ized threshold prepared for each hue or every lightness and said 
binary-ized threshold is included. 

[0005] After setting an inspecting region as the predetermined location on the image which 
this mounting components test equipment picturized the inspected substrate on the occasion 
of inspection of an inspected substrate based on said instruction data, and was obtained, the 
feature parameter in an inspecting region is extracted using said binary-ized threshold, and 
the mounting quality of components is judged for this feature parameter as compared with a 
reference value. 
[0006] 

[Problem(s) to be Solved by the Invention] Among the above-mentioned instruction data, 
especially about the setting-out location of an inspecting region, since it is necessary to 
teach accuracy for every each part article, an instruction activity takes a great effort and 
time amount. The location gap of the inspecting region moreover set up based on said 
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instruction data at the time of inspection when it was delicately shifted from the mounting 
position where the mounting position of inspected components was taught or the error was in 
positioning of the inspected substrate to test equipment is carried out from a subject of 
examination, and the problem of an exact inspection becoming impossible produces it. 
[0007] While this invention improves inspection precision substantially by having been made 
paying attention to the above-mentioned problem, extracting the image to be examined which 
exists near the setting-out location of the inspecting region where it was beforehand taught 
on the image, and changing the setting-out location of an inspecting region based on this 
extract result, it aims at reducing substantially the time amount concerning instruction of the 
setting-out location of an inspecting region, and efforts. 
[0008] 

[Means for Solving the Problem] In the approach of invention of claim 1 setting up the 
inspecting region of components on the image which picturized the mounting components on 
a substrate and was obtained, and inspecting the mounting quality of components using the 
image data in this inspecting region After extracting the image to be examined which exists 
near the setting-out location of the inspecting region where it was beforehand taught on said 
image and changing the setting-out location of said inspecting region based on this extract 
result, it is characterized by judging the mounting quality of components using the image data 
in the inspecting region after modification. 

[0009] A storage means for invention of claim 2 to be mounting components test equipment 
for realizing the above-mentioned approach, and to memorize the setting-out location of said 
inspecting region, The image data near the setting-out location of the inspecting region 
memorized by said storage means on the inputted image is processed. An image extract 
means to extract an image to be examined, and a setting-out repositioning means to change 
the setting-out location of said inspecting region based on the extract result by said image 
extract means, It has an inspecting region setting-out means to set said inspecting region as 
the setting-out location changed by said setting-out repositioning means, and a judgment 
means to judge the mounting quality of components using the image, data in the inspecting 
region set up by said inspecting region setting-out means. 

[0010] In invention of claim 3, said image extract means processes the image data in a 
predetermined field including the setting-out location of said inspecting region, and is 
extracting the image of the land of components to be examined. 
[0011] 

[Function] Even if it is carrying out the location gap of the mounting components in the 
image picturized and obtained from the setting-out location of the inspecting region where 
the subject of examination was taught, the setting-out location of an inspecting region is 
changed based on the extract result of this image to be examined, and an inspecting region is 
positioned by accuracy on a subject of examination. 
[0012] 

[Embodiment of the Invention] As an example for carrying out each invention of claims 1-3, 
the mounting components test equipment of a configuration like drawing 1 is mentioned, the 
inside of the teaching table 19 of this mounting components test equipment — each the 
setting-out data of two or more inspecting regions which receive inspected components 2T 
are memorized. At the time of inspection, after each inspecting region is initialized in the 
setting-out location taught first, the image of the land in the check window W4 (shown in 
drawing 2 and drawing 6 ) is extracted, and modification processing of the inspecting region 
by the inspecting region setting-out section 17 is further performed based on this extract 
result. 
[0013] 

[Example] Drawing 1 shows the whole mounting components test equipment configuration 
concerning one example of this invention. The feature parameter of the inspecting region of 
each part article 2S on said criteria substrate IS which this mounting components test 
equipment picturized criteria substrate IS with good mounting quality, and were obtained, It 
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is for comparing the feature parameter of the inspecting region of each part article 2T on said 
inspected substrate IT which picturized inspected substrate IT and were obtained, and 
inspecting the mounting quality of each part article 2T. The X-axis table section 3, the Y- 
axis table section 4, the floodlighting section 5, the image pick-up section 6, the control 
processing section 7, etc. are included as the configuration. 

[0014] Said X-axis table section 3 and the Y-axis table section 4 move the conveyer 8 by 
which it has the motor (not shown) which operates based on the control signal from the 
control processing section 7, respectively, and the X-axis table section 3 moves the 
floodlighting section 5 and the image pick-up section 6 to X shaft orientations actuation of 
these motors, and the Y-axis table section 4 supports Substrates IS and IT to Y shaft 
orientations. 

[0015] Said floodlighting section 5 is constituted by the three light sources 9, 10, and 11 in a 
circle which have a different path and irradiate red light, green light, and blue glow 
simultaneously'based on the control signal from the control processing section 7, and doubles 
a core with a right above [ an observation post ] location for each light sources 9, 10, and 
11, and is located in the direction corresponding to an elevation angle which sees and is 
different from an observation post. 

[0016] Said image pick-up section 6 is a color-television camera, and is positioned caudad 
towards the right above [ an observation post ] location. The reflected light of the front face 
of the substrates IS and IT which are the objects for observation by this is picturized by the 
image pick-up section 6, is changed into the color signals R, G, and B in three primary 
colors, and is supplied to the control processing section 7. 

[0017] Said control processing section 7 consists of the image input section 12, memory 13, 
the image pick-up controller 14, the image-processing section 15, the X-Y table controller 
16, the inspecting region setting-out section 17, the judgment section 18, the teaching table 
19, a control section 20, a keyboard 21, the CRT display section 22, a printer 23, the 
transceiver section 24, a floppy disk drive unit 25, etc. 

[0018] Said image input section 12 inputs the color signals R, G, and B from said image pick- 
up section 6, and changes them into a digital signal, and the shade image data of the digital 
quantity for every hue is transmitted to the image data storage area in memory 13. 
[0019] The image pick-up controller 14 is equipped with the interface which connects a 
control section 20, the floodlighting section 5, and the image pick-up section 6, and based on 
the output of a control section 20, the quantity of light of each light sources 9-11 of the 
floodlighting section 5 is adjusted, or it controls maintaining the mutual balance of each hue 
optical output of the image pick-up section 6 etc. 

[0020] The X-Y table controller 16 is equipped with the interface which connects a control 
section 20, said X-axis table section 3, and the Y-axis table section 4, and controls 
actuation of the X-axis table section 3 and the Y-axis table section 4 based on the output of 
a control section 20. 

[0021] After the image-processing section 15 extracts whenever [ lightness and in three 
primary colors hue ] per pixel from the red and each green and blue image data R, G, and B 
which were stored in memory 13, it performs binary-ized processing: by the predetermined 
binary-ized threshold memorized by the teaching table in this extract result, respectively, 
extracts the feature parameter of each part article, and supplies this to the judgment section 
18 as data for inspected. 

[0022] The teaching table 19 has memorized the program (henceforth a "checking program") 
into which the criteria (henceforth a "criterion") for judging the setting-out location 
(henceforth "field setting-out data") of the inspecting region for every components besides 
the binary-ized threshold for extracting each above mentioned feature parameter as 
inspection information and the quality of said feature parameter, the procedure of inspection, 
etc. were built for every inspected components. Such inspection information is supplied to 
the image-processing section 15, the inspecting region setting-out section 17, the judgment 
section 18, etc. through a control section 20 at the time of inspection. 
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[0023] The inspecting region setting-out section 17 sets up a predetermined inspecting 
region on inspected components 2T in the procedure which said field setting-out data are 
supplied and is mentioned later. Moreover, a binary-ized threshold is given to the image- 
processing section 15, and the data for inspected [ about each inspecting region of inspected 
components 2T ] are generated. Moreover, the judgment section 16 receives supply of a 
checking program, a criterion, etc., judges each part article 2T per mounting quality of 
inspected substrate IT for the data for inspected transmitted from said image-processing 
section 15 based on the checking program as compared with a criterion, and outputs the 
judgment result to a control section 20. A control section 20 synthesizes the judgment result 
about each part article, and inspected substrate IT judge whether it is an excellent article, 
and it outputs the judgment result to the CRT display section 22 or a printer 23. 
[0024] The keyboard 21 is equipped with various keys required to input actuation 
information, the data about criteria substrate IS and inspected substrate IT, etc., and key 
input data are supplied to said control section 20. 

[0025] The CRT display section 22 displays this on the display screen, when image data, an 
inspection result, key input data, etc. are supplied from a control section 20, and when an 
inspection result etc. is supplied from a control section 20, it prints out a printer 23 with the 
format which was able to determine this beforehand. 

[0026] The transceiver section 24 is for performing transmission and reception of solder 
correction equipment, a host computer, etc. which are not illustrated, and data, and performs 
transmission and reception of various data, such as transmission of data, such as an 
inspection result, and reception of the library data mentioned later. The floppy by which 
library data etc. were stored is set in a floppy disk drive unit 25, and R/W of data is 
performed through a control section 20. 

[0027] He is trying to use for this mounting components test equipment the library data into 
which inspection information, such as said field setting-out data, a binary-ized threshold, a 
criterion, and a checking program, was edited for every components of the same specification 
on the occasion of the teaching of said inspection information. It is incorporated in memory 
13 through said transceiver section 24 and floppy disk drive unit 25, and also this library data 
is suitably edited using the image data of a criteria substrate, the input data from a keyboard 
21, etc. 

[0028] Drawing 2 shows the library data of the inspecting region set up about the angle chip. 
This library data is what is edited using the image which picturizes the model of an angle chip 
and is obtained. Wl among drawing The inspecting region (henceforth "the land window Wl") 
for being set up on the image of a land and conducting solder inspection W2 An inspecting 
region (henceforth window W3 of "components body) for W3 to inspect the size of 
components for the inspecting region (henceforth "the body window W2") for inspecting lack 
of components is shown, respectively. 

[0029] Moreover, W4 is a window which has the predetermined magnitude which contains 
each aforementioned window Wl - W3 in the center section, it is used in order to position 
each window Wl - W3 eventually at the time of inspection, and also it is used in order to 
check the existence of a gap of components or the bridge of solder so that a postscript may 
be carried out (this window W4 will be hereafter called "the window W4 for a check"). 
[0030] The setting-out location to the components of each above-mentioned windows Wl- 
W4 is beforehand memorized as library data, and at the time of teaching, according to this 
library data and the mounting position of components, the setting-out location of each 
windows W1-W4 is called for, and it is taught as said field setting-out data. 
[0031] Drawing 3 shows the procedure of teaching. First, in steps 1 and 2 of this drawing, 
after an operator registers the substrate name which operates a keyboard 21 and is made 
applicable to instruction, he keys substrate size, sets criteria substrate IS on the Y-axis 
table section 4 at step 3 further, and does the push operation of the start key. 
[0032] if each corner of the zero of criteria substrate IS and upper right, and the lower left is 
made to picturize in the image pick-up section 6 and the actual size of criteria substrate IS 
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is inputted with the location of each point at step 4 next, a control section 20 controls the 
X-axis table section 3 and the Y-axis table section 4 based on input data, will carry out 
location appearance of criteria substrate IS to an initial position, and will make them it. 
[0033] If said criteria substrate IS have the good mounting quality by which components 2S 
predetermined were soldered to the component-mounting location proper and these criteria 
substrate IS are positioned in an initial position, the field whose image pick-up section 6 is 
criteria substrate IS will be picturized at the following step 5, and the mounting position of 
components will be taught. 

[0034] At the following step 6, a control section 20 displays on the CRT display section 22 a 
list of the components kind with which library data are memorized. If an operator chooses the 
components kind corresponding to components 2S to which the mounting position was taught 
from the displayed components kind list, a control section 20 reads the library data about 
this components kind from memory 13, and saves this data in the teaching table 19 as 
instruction data about components 2S. 

[0035] If the same procedure is repeatedly performed about all the components on criteria 
substrate IS, the judgment of step 7 will serve as "YES" and will shift to eight or less-step 
correction teaching. This correction teaching is processing which the quality of mounting 
quality carries out test inspection of the known substrate actually with the instruction data 
generated at said steps 5 and 6, and corrects the taught checking data to the optimal thing. 
[0036] First, at step 8, a control section 20 sets said criteria substrate IT as an initial 
position again, extracts an image pattern sequentially from the first components to be 
examined using the taught inspection information, and judges the quality of the mounting 
quality of each part article. In addition, this inspection routine is the same as the procedure 
of drawing 7 mentioned later, and that detailed explanation is omitted here. 
[0037] If the judgment result that mounting quality is poor is obtained about one of 
components as a result of the above-mentioned inspection, step 9 will serve as "YES" and an 
operator will make correction of instruction data, such as changing the binary-ized threshold 
for extracting a feature parameter about the components judged that are poor, (step 10). 
[0038] After the correction processing about all the components judged that are poor is 
completed, step 11 serves as "YES", and a control section 20 repeats and performs the 
procedure after step 8 again. When it is carried out repeatedly and step 9 serves as "NO" 
until the components judge that is [ this loop formation ] poor are lost, final inspection 
information is generated. In addition, the optimal inspection information can be acquired by 
performing correction teaching of multiple times using an excellent article substrate with 
good mounting quality, and a defect substrate with faulty mounting quality. 
[0039] At the time of inspection, each windows W1-W4 are set up based on the setting-out 
location data taught first. A gap is in the mounting position of components at this time, or an 
error is in positioning of inspected substrate 2T, and when having shifted from on the subject 
of examination to which said window Wl - W3 correspond, the setting-out location of a 
window Wl - W3 is changed by the inspecting region setting-out section 17, and it shifts to 
inspection. 

[0040] Each window Wl which drawing 4 shows the example of initialization of the window to 
an angle chip, and was shown in said drawing 2 - W3 are set as the location [ image / 28 / 
the images 26 and 27 of a land to be examined, or / of the body of components ] shifted a 
little, respectively. 

[0041] Drawing 6 shows the concrete setting-out approach of each window for the 
configuration procedure of each window to the aforementioned angle chip, respectively, and 
drawing 5 develops detailed explanation about the procedure of drawing 5 hereafter, referring 
to drawing 6 . The field setting-out data memorized by said teaching table 19 through the 
control section 20 are supplied to the inspecting region setting-out section 17, and the 
inspecting region setting-out section 17 initializes each window in the location based on the 
field setting-out data on an image at the first step A first. 

[0042] Next, a control section 20 supplies the predetermined binary-ized threshold 



QP,09-145334,A] 



memorized by the image-processing section 15 at said teaching table 19. With this binary- 
ized threshold, the image-processing section 15 performs binary-ized processing of the image 
data in said check window -W4, and extracts the land part on an image (step B). 
[0043] At the following step C, the inspecting region setting-out section 17 moves each land 
windows Wl and Wl, and the setting-out location of the land windows Wl and Wl is 
changed so that the image of each extracted land may be contained in a window, respectively 
( drawing 6 (1)). In addition, a change of this setting-out location is made by the approach of 
changing the coordinate of the lower left point of a window, and an upper right point, 
respectively. 

[0044] At the following step D, the inspecting region setting-out section 17 moves the body 
window W2 on the basis of the location of the changed land windows Wl and Wl, and the 
body window W2 is positioned in the location where the relative-position relation of each 
windows Wl, Wl, and W2 becomes the same as the relative-position relation at the time of 
initialization memorized by the teaching table 19 ( drawing 6 (2)). 

[0045] Next, a control section 20 sets a different binary-ized threshold from the above to the 
image-processing section 15, makes binary-ized processing perform, and makes the image 
part of the body of components extract in the check window W4 (step E). If existence of 
components is checked by this extract processing, step F will serve as "YES" and it will shift 
to step G, and the inspecting region setting-out section 17 will change the setting-out 
location of window W3 of a components body so that the image of the extracted body of 
components may be contained in this window W3 of a components body. 
[0046] On the other hand, when the image of the body of components is not checked in the 
check window W4 Step F serves as "NO" and it shifts to step H. The inspecting region 
setting-out section 17 Window W3 of a components body is moved like said body window W2 
on the basis of the location of the changed land windows Wl and Wl. Window W3 of a 
components body is positioned in the location where the relative-position relation to each 
land windows Wl and Wl of this window W3 of a components body becomes the same as the 
relative-position relation at the time of initialization memorized by the teaching table 19 
( drawing 6 (3)). 

[0047] Drawing 7 shows the control procedure of the automatic check by the control 
processing section 7. The substrate name which an operator should inspect at steps 1 and 2 
of this drawing is chosen, initiation actuation of substrate inspection is performed, and the 
supply of inspected substrate IT to mounting components test equipment is checked at the 
following step 3. If the judgment is "YES", a conveyer 8 will operate, inspected substrate IT 
will be carried in to the Y-axis table section 4, and an automatic check will be started (steps 
4 and 5). 

[0048] In step 5, a control section 19 controls the X-axis table section 3 and the Y-axis 
table section 4. It is made to picturize by positioning the visual field of the image pick-up 
section 6 to the 1st components 2T on inspected substrate IT. In the same procedure as 
step A-H of said drawing 5 After setting up the inspecting region by the inspecting region 
setting-out section 17 to these components 2T, the sequential extract of the feature 
parameter in each inspecting region is carried out, the judgment section 18 is supplied, and 
inspection about inspection items, such as a solder condition, components lack, and 
components size, is performed. 

[0049] Finally the judgment section 18 confirms whether the feature parameter which shows a 
gap of components and the bridge of solder exists in the image field (a slash shows among 
drawing 8 ) which does not include other windows in said check window W4. The feature 
parameter which drawing 9 shows the example which the revolution gap produced to the body 
of components, and shows some bodies of components in the field of the slash in the check 
window W4 in this case is extracted, and it becomes clear that the mounting condition of 
components is poor. 

[0050] drawing 7 — return — such inspection — all the components 2 on inspected 
substrate IT — if repeat activation be carried out per T, consequently components with a 
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faulty mounting condition existed, after the judgment of step 6 will serve as "NO", and the 
defect components and content of a defect will be display on a display 20 or be print by the 
printer 21, inspected substrate IT be take out from the Y-axis table section 4 (steps 7 and 
8). If all are performed for the same inspection routine per [ inspected substrate IT ] in this 
way, the judgment of step 9 will serve as "YES" and inspection will be completed. 
[0051] 

[Effect of the Invention] In case this invention sets up a predetermined inspecting region on 
the image which picturized the mounting components on a substrate and was obtained like 
the above and inspects the mounting quality of components The image to be examined which 
exists near the setting-out location of the inspecting region where it was beforehand taught 
on the image is extracted. Since the setting-out location of an inspecting region was changed 
based on this extract result, an inspecting region can be positioned on a subject of 
examination at accuracy at the time of inspection, and inspection precision can be improved 
substantially. Moreover, since it becomes unnecessary to determine the setting-out location 
of an inspecting region strictly oh the occasion of teaching, the remarkable effectiveness 
which attained the invention object is done so — the time amount and the efforts concerning 
an instruction activity are reducible. 
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DESCRIPTION OF DRAWINGS 
[Brief Description of the Drawings] 

[Drawing 1] It is the block diagram showing the outline configuration of the mounting 
components test equipment concerning one example of this invention. 

[Drawing 2] It is the explanatory view showing an example of the library data concerning an 
inspecting region. 

[Drawing 3] It is the flow chart which shows the procedure of teaching. 

[Drawing 4] It is the explanatory view showing the inspecting region initialized at the time of 
inspection. 

[Drawing 5] It is the flow chart which shows the configuration procedure of an inspecting 
region. 

[Drawing 6] It is the explanatory view showing the modification procedure of the setting-out 
location of each inspecting region. 

[Drawing 7] It is the flow chart which shows inspection routine. 

[Drawing 8] It is the explanatory view showing the inspecting region for conducting a gap of 
the body of components, and inspection of a bridge. 

[Drawing 9] It is the explanatory view showing the condition that the body of components 
shifted. 

[Description of Notations] 
IT Inspected substrate 
2T Inspected components 

17 Inspecting Region Setting-Out Section 

18 Judgment Section 

19 Teaching Table 

20 Control Section 
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